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We introduce a class of quantum heat engines which consists of two-energy-eigenstate systems, 
the simplest of quantum mechanical systems, undergoing quantum adiabatic processes and energy 
exchanges with heat baths, respectively, at different stages of a cycle. Armed with this class of heat 
engines and some interpretation of heat transferred and work performed at the quantum level, we are 
able to clarify some important aspects of the second law of thermodynamics. In particular, it is not 
sufficient to have the heat source hotter than the sink, but there must be a minimum temperature 
, difference between the hotter source and the cooler sink before any work can be extracted through 

■ the engines. The size of this minimum temperature difference is dictated by that of the energy 

' gaps of the quantum engines involved. Our new quantum heat engines also offer a practical way, as 

, an alternative to Szilard's engine, to physically realise Maxwell's daemon. Inspired and motivated 

by the Rabi oscillations, we further introduce some modifications to the quantum heat engines 
with single-mode cavities in order to, while respecting the second law, extract more work from the 
^ heat baths than is otherwise possible in thermal equilibria. Some of the results above are also 

'^'h , generalisable to quantum heat engines of an infinite number of energy levels including 1-D simple 

' harmonic oscillators and 1-D infinite square wells. 
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I. INTRODUCTION 



The second law has started out as a "no-go" statement against a certain class of perpetual machines but is now 
a pillar of modern physics, supported by experimental evidence without exception so far. While the first law of 
^y-^ ' thermodynamics is a statement of quantity about energy conservation, the second law is a statement of quality about 
I what kinds of energy transformations are and are not allowed. T,here are several classical statements of the second 
law [112: 

0^1 • Kelvin-Planck: No process is possible whose sole result is the absorption of heat from a reservoir and the 

conversion of this heat into work. 

Ch 

■ • Clausius: No process is possible whose sole result is the transfer of heat from a cooler to a hotter body. 

A ' 

qh| • Entropy Maximum Postulate: The entropy of a closed system never decreases in any process. 

The first two statements above can be shown to be equivalent by the introduction of intermediate heat engines. And 
• the last postulate requires the introduction of entropy which is a function of extensive parameters of a composite 

' system, defined for all equilibrium states and having certain properties. 
^ . Entropy of a composite system in a macro-state can be linked, in statistical physics, to the statistics of the many 
micro-states that correspond to the same macro-state. In order to satisfy the statistical nature of entropy and to 
derive the principle of increasing entropy, several fundamental assumptions are required 

• The composite system has a large number of components (atoms, molecules, etc.). 

• These components can be divided into a small number of classes of indistinguishable components. (In fact, were 
every molecule of a gas assumed to be different from each other then statistical physics would become fairly 
simple but useless as it would not be able to account for the non-decreasing fiow of entropy.) 

• Boltzmann's fundamental hypothesis all micro-states are equally probable. This is termed as elementary 
disorder by Planck and has been generalised to the quantum domain as the hypotheses of equal a priori prob- 
abilities and random a priori phases for the quantum states of a system . All of these can be subsumed by 
the (somewhat stronger) ergodic hypothesis '3| which postulates that the dynamical time average is equal to the 
ensemble average (of appropriate ensembles) , except for a number of exceptional initial conditions of relatively 
vanishing importance. 
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No matter how reasonable the last assumption may be, it should be pointed out that those hypotheses are not a part 
of but are extra to the first principles of quantum mechanics. 

The second law was indeed the motivation and the philosophical reason for Max Planck to introduce the concept 
of energy quanta in his solution for the puzzle of black-body radiation ,3| . His line of reasoning can be rephrased as 
follows: the second law is about irreversibility in nature; irreversibility does nothing but defines a preference of the 
more probable over the less probable; and the probability assignment for physical states (in order to have the more 
and the less probables) requires those states to belong to a distinguishable variety of possibilities. This led Planck to 
the conclusion that the atomic hypothesis must be necessary. And the rest was history; the concept of quanta was 
then born as the states of discrete homogeneous elements. In that context, the study of heat engines in the quantum 
domain in relation to the second law is a contribution to a completion of the circle that was started at the beginning 
of the last century. 

Present technology now allows for the probing and/or realisation of quantum mechanical systems of mesoscopic and 
even macroscopic sizes (like those of superconductors, Bose-Einstein condensates, etc.) which can also be restricted 
to a relatively small number of energy states. It is thus important to study these quantum systems directly in relation 
to the second law. Our study, started with lal and further expanded in this paper, is part of a growing body of 
investigations into quantum heat engines 

U UU E in da, Jl, 14, il El- Explicitly, the only principles we will 
need are those of the Schrodinger equation, the Born probability interpretation of the wavefunctions and the von 
Neumann measurement postulate [l7l |. In particular, we will not exclude, but will make full use of, any exceptional 
initial conditions, as long as they are realisable physically. However, without a better understanding of the emergence 
of classicality from quantum mechanics, we will also have to assume the thermal equilibrium Gibbs distributions for 
the heat baths that are coupled to the quantum systems. This assumption is related to the fundamental assumptions 
mentioned above and is extra to those of quantum mechanics. Even though we do not impose this extra assumption 
on the quantum mechanical systems, the steady-state distributions for the systems will eventually reach the Gibbs 
distributions in time because of the coupling with the heat baths, see eq. (I14II below. 

In order to introduce a class of heat engines operating entirely in the framework of quantum mechanics, we will need 
a quantum interpretation of the transfer of heat and performance of work in the next Section. This interpretation 
is also necessary for a review of the second law and for a possible realisation, as an alternative to Szilard's engine, 
of Maxwell's daemon in Sections IIIII and IIVI The quantum heat engines are then considered next both in thermal 
equilibrium and also in thermal non-steady states, in Sections IVI and IVIl We find from these quantum considerations 
that even though the second law is not violated in a broad sense, it needs some refinements and clarifications. We 
also demonstrate that more work can be extracted by the engines in non-steady states than otherwise is possible in 
thermal equilibrium. Section [VIII Section [VIIII provides an explicit numerical illustration of such capability. We then 
discuss Maxwell's daemon further in Section llXl as the reason behind any violation of the second law were we ever able 
to control the quantum phases of the heat baths. Sections Q and IXII contain some generalised results for quantum 
heat engines with simple harmonic oscillators and infinite square wells, respectively, all in one dimension. Finally, we 
end the paper with some concluding remarks in the final Section IXIII 



II. QUANTUM IDENTIFICATIONS OF HEAT EXCHANGED AND WORK PERFORMED 

The expectation value of the measured energy of a quantum system with discrete energy levels is 

U={E) = Y^p^E,, (1) 

i 

in which Ei are the energy levels and pi are the corresponding occupation probabilities. Infinitesimally, 

dU = Y,{E^dp^+P^dE,}, (2) 

i 

from which we make the following identifications for infinitesimal heat transferred dQ and work done dW 

dQ := y^£^» dpi, 

i 

dW := Y.P^'^^^- (3) 

i 

Mathematically speaking, these are not total differentials but are path dependent. These expressions interpret heat 
transferred to or from a quantum system as the change in the occupation probabilities but not in the change of the 
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energy eigenvalues themselves; and work done on or by a quantum system as a redistribution of the energy eigenvalues 
but not of the occupation probabilities of each energy level. Together with these identifications, equation ||2J) can be 
seen as just an expression of the first law of thermodynamics, dU = dQ +dW. 

The above link between the infinitesimal heat transferred to the infinitesimal change of occupation probabilities is 
in accord with, or at least is not in contradiction to, the thermodynamic link between heat and entropy, dQ = T dS, 
in combination with the statistical physical link between entropy and probabilities, S — —k'Y^^pi \npi. On the other 
hand, expression linking work performed to the change in energy levels agrees with the fact that work done on 
or by a system can only be performed through a change in t he g eneralised coordinates of the system, which in turn 
gives rise to a change in the distribution of the energy levels jig- 



III. A CLASS OF QUANTUM HEAT ENGINES 



The quantum heat engines considered herein are just two-energy-level quantum systems, the simplest of quantum 
mechanical systems, operated in a cyclic fashion described below. (They are the quantum analogue of the classical 
Otto engines and are readily extendable to systems of many discrete energy levels.) They could perhaps be realised 
with coherent macroscopic quantum systems like, for instance, a Bose-Einstein condensate confined to the bottom 
two energy levels of a trapping potential. The exact cyclicity will be enforced to ensure that upon completing each 
cycle all the output products of the engines are clearly displayed without any hidden effect. 

A cycle of the quantum heat engine consists of four stages: 

• Stage 1: The system has some probability to be in the lower state prior to some kind of contact (whose nature 
will be discussed later on) with a heat bath at temperature Ti. After some time interval, there is a probability 
that the system receives some energy from the heat bath to jump up an energy gap of Ai to be in the upper 
state. According to the identification above, only heat is transferred in this stage to yield a change in the 
occupation probabilities, and no work done as there is no change in the values of the energy levels. This stage 
is depicted on the left hand side of Fig. 

• Stage 2: The system is then isolated from the heat bath and undergoes a quantum adiabatic expansion, whose 
nett result is to reduce the energy gap from Ai to a smaller value At- In this stage, provided the expansion rate 
is sufficiently slow according to the quantum adiabatic theorem |l9j . the occupation probabilities for the two 
states remain unchanged. The system may perform an amount of work. This is depicted as the upper branch 
of Fig. n running from left to right. Note that there is no change in probability so there is no heat transferred; 
that is, a quantum adiabatic process implies a thermodynamic adiabatic process (but not the other way around, 
in general). 

• Stage 3: The system is next brought into some kind of contact with another heat bath at temperature T2 for 
some time. There is a probability that it releases some energy to the bath to jump down the gap A2 to be in 
the lower state. This is depicted on the right hand side of Fig. Some heat is thus transferred but no work is 
performed in this stage. 

• Stage 4-' The system is removed from the heat bath nd undergoes a quantum adiabatic contraction, whose nett 
result is to increase the energy gap from A2 back to the previously larger value Ai. This is depicted as the 
lower branch of Fig. ^ running from right back to left. In this stage an amount of work is done on the system. 

Ideal quantum adiabatic processes are employed here because they yield, on the one hand, the maximum amount of 
work performable by the systems in stage 2 (as the transition probabilities to the lower state in that stage can be made 
vanishingly small according to the quantum adiabatic theorem), but yield the minimum amount of work performable 
on the systems (by some external agents) in stage 4, on the other hand. In each cycle the amount of work done by the 
system is (Ai — A2), which is also the nett amount of heat it absorbs. Note that we need not and have not assigned 
any temperature to the quantum system; all the temperatures are properties of the heat baths, which in turn are 
assumed to be in the Gibbs state. 

However, in the operation above, the absorption and release of energy in stages 1 and 3 occur neither definitely nor 
deterministically. Quantum mechanics tells us that they can only happen probabilistically; and the probabilities that 
such transitions take place depend on the details of the interactions with and some intrinsic properties (namely, the 

temperatures) of the heat baths. 
(1 2) 

Let pu he the probabilities for the system to be in the upper level at the beginning of stages 2 and 4, respectively. 
The nett work done by our quantum heat engines in the two quantum adiabatic passages in stages 2 and 4 is 
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FIG. 1: On the left hand side, a two-state quantum system in the lower state comes into contact with a heat bath at temperature 
Ti for some time until it absorbs an amount of energy Ai to jump into the upper state. Next in the passage to the right hand 
side, the system undergoes a quantum adiabatic process, remaining in the upper state, and performs work on the relaxing 
potential wall. On the right hand side, the system comes into contact with another heat bath at temperature T2 for some time 
until it releases an amount of energy A2 to jump back to the lower state. In the final passage to the left hand side to complete 
a cycle of the heat engine, the system undergoes another quantum adiabatic process in which it remains in the lower state and 
work is done on the system by the compressing potential wall. 



We will make full use of this simple expression in the Sections below. 

By the weak law of large numbers, probability reflects the relative occurrence frequency of an event in a large 
number of repetitions. In the case of thermal equilibrium with only one single heat bath (Ti = T2), even with a 

small probability pi^\l — p^^) the system could be in the upper level in stage 2 and in the lower level in stage 4, 
where p is the thermal equilibrium probabilities in (O below. The probability, however, diminishes exponentially for 
ric consecutive cycles, —pi^-* ))""=, in all of which the system would perform nett work on the environment. As 

a result, there are certain cycles whose sole result is the absorption of heat from a reservoir and the conversion of this 
heat into work, of the amount (Ai — A2)! 

This amounts to a violation of the Kelvin-Planck statement of the second law due to the explicit probabilistic 
nature of quantum mechanical processes. This violation of classical statements for the second law, however, occurs 
only randomly, with some vanishingly small probability in the longer term, and thus is not controllable - neither 
harnessible nor exploitable. 

This may seem non-surprising given the statistical nature of the second law, but it is somewhat different from the 
usual scenario of violation of the second law by statistical fluctuations in the bulk. One example of this latter scenario 
is the instantaneous concentration of all the gas molecules in a big room into one of its corners. Mathematically, 
this configuration is permissible due to the existence of the Poincare cycles in mechanics, but statistical physics 
effectively rules this out (gives it a vanishing probability) by invoking extra assumptions and hypotheses as mentioned 
in Section^] The scenario with our quantum heat engines is different in that it only involves a single (macro) quantum 
system with physically realisable quantum mechanical probabilities, and without any extra hypothesis. The subtle 
difference between the two cases is in the time average for a single system, on the one hand, and the bulk average for 
systems having many subcomponents, on the other. 
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IV. A REALISATION OF MAXWELL'S DAEMON 



However, there exists a sure way to always extract work, to the amount of (Ai — A2), in each completable "cycle" 
described in Section IIIII In order to ehminate the probabihstic uncertainty in the thermahsing contacts with heat 
baths, 

• we prepare the system to be in the lower state prior to stage 1; 

• we perform an energy measurement after stage 1 and then only let the engine continue to stage 2 subject to the 
condition that the measurement result confirms that the system is in the upper state; if this is not the case, we 
go back to the last step above; 

• we next perform another measurement after stage 3 and then only let the engine continue to stage 4 subject to 
the condition that the measurement result confirms that the system is in the lower state; if this is not the case, 
we go back to the last step above. 

All the steps above is to ensure pi^^ = 1 and pi^"* = 0, irrespective of the heat bath temperatures, and thus to be 
always able to derive maximum work according to Q). That is, all this can be carried out even for the case Ti < T2 
to always extract, in a controllable manner, some work which would have been otherwise prohibited by the second 
law. 

This apparent violation of the second law is analogous to that of Szilard's one-atom engine and is nothing but the 
result of an act of Maxwell's daemon |23|. Indeed, the condition of strict cyclicity of each engine's cycle is broken 
here. After each cycle the measurement apparatus, being a Maxwell's daemon, has already registered the conditioning 
results which are needed to determine the next steps of the engine's operation. In this way, there are extra effects and 
changes to the register/memory of the apparatus, even if we assume that the quantum measurement steps themselves 
cost no energy and leave no nett effect anywhere else. To remove these remnants in order to restore the strict cyclicity, 
we would need to bring the register back to its initial condition by erasing any information obtained in each of the 
cycles, either by resetting its bits or by thermalising the register with some heat bath. Either way, extra effects are 
inevitable, namely an amount of heat of at least fcTln2 will be released per bit erased. This is the Landauer principle 
which saves the second law. More extensive discussions and debates on these issues can be found in the literature .20| . 
and in particular in the quantum version of Szilard's engine by Zurek Lloyd in 21] has analysed carefully and 
in detailed the Landauer principle behind the working of Maxwell's daemon entirely in the framework of quantum 
mechanics. Maxwell's daemon has also been discussed 22] in the context of quantum error correction in quantum 
computation. 

Our quantum heat engines could thus provide, in a different way to Szilard's engine, a feasible and quantum 
mechanical way to realise Maxwell's daemon. 



We have pointed out in Section IIIII that there are random instances where our quantum heat engines can extract 
heat from a single heat bath and totally turn that into work or, equivalently, can transfer heat from a cold to a hot 
source (and may also do some work at the same time). Nonetheless, on the average, there is no violation of the second 
law. 

If the system is allowed to thermalise with the heat baths in stages 1 and 3, the thermal equilibrium probabilities 
for the two energy levels only depend on the relevant temperatures and the energy gaps, but not on the initial states 
when the system is brought into contact with the heat bath, see (I14f) below. More explicitly, the probability pi^"* to 
have the system in the upper state at the end of stage 1 after being thermalised with the heat bath at temperature 
Ti, and p„ at the end of stage 3 after being thermalised with the heat bath at temperature T2, respectively, are 



This is negative (that is, work has been performed by our engines), given that Ai > A2, if and only if as can be 
seen from 



V. THERMAL STEADY STATES 



pi*) = 1/ (1 + exp{A,/fcT,}) , for ^ = 1, 2. 
These probabilities are definitely non-zero and bounded by 0.5. From which, the work derived from is 



(5) 
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which is to be compared with the necessary condition of the classical statement of the second law that Ti is simply 
greater than T2. 

One might think that the last result is just another equivalent restatement of the second law by arguing that the 
entropy decreased in the heat bath in stage 1 must be, according to the usual statement of the second law, less than 
the entropy increased in the other heat bath in stage 3, 

and by assuming that AQ^ — A^, for both i, upon which Q would have immediately followed. However, this 
assumption is not justifiable because the heat AQi released by the hot heat bath, on the average, cannot be the same 
as the energy gap Ai of the system at that point; and likewise for the heat absorbed by the colder reservoir. These 
heat amounts must be, on the average, less than the corresponding energy gaps because the heat absorbed/released 
by the quantum system must be moderated by the change in occupation probabilities (see Q), but such a change 
in the occupation probability for a specific level is always less than one. In other words, the energy gaps A^'s are 
the maximum energy transfers possible in any exchange but the probability distributions in thermal equilibrium will 
not allow those maximum values to be reached. However, the result Q is consistent with the second law (jS)) in the 
sense that it can be derived from (|SJ) if AQ^ is proportional to A^ and if the proportionality constants (which are less 
than one) are the same for both i — \,2. But such a proportionality is extra ingredient to the second law (jS]), and 
is a consequence of the same cause that also leads to {TJ. Consequently, our derived result {Tjl is a refinement of the 
classical statement of the second law, and not simply a restatement in another equivalent form. 

The expressions (0J and (O not only confirm the broad validity of the second law but also refine the law further 
in specifying how much Ti needs to be larger than T2 before some work can be extracted. In other words, work 
cannot be extracted, on the average, even when Ti is greater than T2 hut less than T2(Ai/A2), in contradistinction 
to the classical requirement that Ti only needs to be larger than T2. The refinement factor (A1/A2) is necessarily 
greater than unity (by the requirement of energy conservation) and is dictated by the quantum structure of the heat 
engines. This result may be extended to multi-level quantum heat engines with appropriate energy gaps, provided 
the quantum energy levels involved are discrete. (See Hi?!, however.) We show in Section^the equivalent condition, 
Ti > T2 {UJ1/UJ2), for quantum simple harmonic oscillators- where uji and uj2 are, respectively, the frequencies of the 
oscillators in the equivalence of stages 1 and 3 above (with ui > 0^2). 

The efficiency of the two-state engines is found to be 

which is independent of temperatures and is the maximum available within the law of quantum mechanics. (A similar 
expression, but through a specific context, was also obtained in 23].) This expression also serves as the upper bound, 
with appropriate Ai and A2, of the efficiency of any quantum heat engine because the work performed by our heat 
engines through their quantum adiabatic processes is the maximum that can be extracted. 
The efficiency is, as a consequence of (0), less than that of the classical Carnot engines, r]c, 

?7g < 1 - T2/T1 EE rjc. (10) 

This is in agreement with a general fact established by Lloyd [2ll | that quantum efficiency must be reduced as more 
information is obtained about the system either by measurement or decoherence. Lloyd argues that when the system 
is in a fully measured or decohered state (that is, when the density matrix is already diagonal with respect to a 
measured or preferred basis) then no further information can be introduced, whence the Carnot efficiency might thus 
be achieved. 

However, the limiting Carnot efficiency may also be approached in the quantum mechanical framework through the 
limit of an infinite number of quantum adiabatic processes 0, ITll ^4] . We illustrate this fact for our quantum heat 
engines in Fig. [3 A similar discussion can also be found with the heat engines of 0| . 

Fig. 121 depicts the inverses of lO, 

A = fcTln Q - 1) ' (11) 

with the labels Ti and T2 correspond to the two temperatures. The rectangle ABCD represents a particular operation 
of our quantum heat engines between two heat baths Ti and T2 - with stage 2 represented by the segment AB (which 
is adiabatic with no change in the probability); stage 3 by EC (no work done with constant energy gap); stage 4 
by CD; and stage 1 by DA, completing an engine cycle. The area of ABCD, by virture of Q), represents the work 
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FIG. 2: Even though the quantum efficiency is always bounded by the Carnot efficiency, a quantum heat engine with asymp- 
toticaUy infinite number of quantum adiabatic steps can have both its efficiency and worlc output per cycle approaching those 
of the latter. This can be seen when the area of the (red) zigzag polygon approaches, from the inside, that of the irregular 
shape bounded by the two outermost vertical lines and the curves labeled T\ and T2. See text for further explanation. 



derivable from this operation, which is less than the area bounded by the two vertical lines AB and CD and the 
two curves, which in turn is the work derivable from a corresponding Carnot engine also operated between the two 
temperatures. 

Now, we modify our heat engines to have AB as the adiabatic expansion, BC the heat exchange, CE the adiabatic 
compression, EF the heat exchange, and so on. When the division becomes finer and finer with more and more 
steps, the area of the (red) zigzag polygon will approach, from the inside, that of the irregular shape bounded by the 
outermost two vertical lines and two horizontal curves. This is the limit when our modified quantum heat engine can 
have both the same work output per cycle and the same efficiency as those of a corresponding Carnot engine. 

We think that this approach will have some interesting consequences in the context of quantum information and 
hope to be able to present further analysis on this limiting scenario elsewhere. 



VI. TRANSITION TO THERMAL STEADY STATES 



Given that the efficiency is bounded by that of Carnot engines, which is another manifestation of the second law, 
can we derive more work (with a larger heat input so that the efficiency bound is maintained) than that obtainable 
from the thermal steady states? In the transient states approaching the thermal equilibria in stages 1 and 3 of a 
quantum heat engines' cycle, the density matrix elements with the upper eigenstate \u) and lower \l) satisfy the 
following equations 24], for i = 1, 2, 

= -(n, + l)rp« + n,rp«, 

= _^,rpf + (n, + i)rpW, (12) 

dtp's - 5,(p«)* = -(n. + i)rp«, 

under the Markovian assumption and the rotating-wave approximation and in which the heat bath is treated as a 
collection of inffnite number of simple harmonic oscillators. In the above, F is the decay rate and we have assumed 
that the thermal average boson number in the heat bath having frequency v = Ai/h is 

n^ = . (13) 

ei'Ti _ 1 

The solution for the differential equations above with the heat bath at Ti is 

p«(t) = e-(^-+i)^* (p«(0) (14) 
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Let the system stay in contact with the heat bath at temperature Ti in stage 1 for a time ti (without achieving 
thermahsation); and for a time T2 at T2 in stage 2. The cychcity of the quantum heat engines requires that 

Pi??(0) = P^^Ti). (15) 

This requirement together with that of pi^^ > imply, from H14|) . 

0< p£'(Ti)-p£)(r2) <p(i)-p(2), (16) 

for finite ti and T2. Subsequently, the work, |AWtr|, that can be derived from transient states at finite ri and T2 is 
always less than that from thermal equilibrium, |AWth|, 

|AWt.| = (p«(ri)-p£)(r2))(Ai-A2), 

< fpP-pP)(Ai-A2), (17) 



< lAW^t 



th| 



We suspect that, as long as the assumption of Gibbs distributions is made for the heat baths, a non-Markovian 
treatment or dropping the rotating wave approximation would not change this last result. Nonetheless, we present in 
the next Section a modification of the quantum heat engines which can better the work derivation than that which is 
maximally available from thermal equilibrium. 



VII. MAXIMISING THE WORK EXTRACTION 

Inspired and motivated by the Rabi flopping for two-level systems, see j23 |. for example, we present in this Section 
a modification of the engines such that more work than usual can be derived from thermal heat sources (as contrast 
to a single-Fock-state field that drives the Rabi flopping), but at the same time more heat input would be needed in 
such a way that the Carnot efficiency is still a valid upper bound. That is, no violation of second law is claimed here 
despite of the enhanced work output. 

A scenario for maximizing the work output from our quantum heat engines is as follows. Firstly, the system is 
prepared to be in the lower state and then subject to a radiation field in a Fock state which has exactly ni quanta 
with a frequency in resonance with the energy gap Ai. After some fixed time ri, depending on the system-field 
coupling strength and on the number m, Rabi oscillations driven by the radiation field will bring the system to the 
upper energy state with certainty. At this point the system can be removed from the field to perform some work in 
an adiabatic process which reduces the energy gap to A2. Then it is next subject to another field of Fock state |n2) 
which has a frequency in resonance with the new gap A2. After some time T2 the system will be in the lower state 
with certainty; upon which it can be decoupled for an adiabatic compression to complete a cycle of the operation. 

In effect, the steps above will remove the probability difference factor in Q), ensuring that a nett work of (Ai — A2) 
is derived in each cycle. The key point here, however, is that a Fock-state field is not a thermal field, and extra work 
or extra information would be required to maintain the Fock state such that the nett book keeping (when full cychcity 
is strictly enforced) will show that we cannot ultimately violate the second law. 

Let us exploit this Rabi mechanism and see how it will behave in a thermal field. 

A cycle of the modified quantum heat engine is depicted in Fig. |2| It also consists of four stages, of which stage 2 
and stage 4 remain the same as described in Section UTTl whereas stages 1 and 3 are replaced respectively by: 

• Stage 1 ': The system has a probability p^i^^ (0) to be in its upper state. It is entered to a single-mode cavity 
which is tuned to match the energy gap Ai of the system and which is in thermal equilibrium with a heat bath 
at temperature Ti . The average occupation of the only mode survived in the cavity has thus a (Bose- Einstein) 
thermal distribution fii given by expression l|13|) . After some carefully controlled time interval ti, the system is 

removed from the cavity to enter stage 2. The probability to find the system in it upper state is now Pm^^(ti). 
Note that, as discussed previously, only heat could be transferred in this stage to yield a change in the occupation 
probabilities, and no work done as there is no change in the values of the energy levels. This stage is depicted 
on the left hand side of Fig. |31 

• Stage 3': The system has a probability p„ (0) to be in its upper state. It is entered into another single-mode 
cavity which is in thermal equilibrium with another heat bath at temperature T2 and which is tuned to match 



FIG. 3: A single-mode cavity is in thermal equilibrium with a bath of black-body radiation at temperature Ti. A two-state 
quantum system spends some time in the cavity whose mode matches the energy gap Ai between its two states. After some 
prescribed time, it leaves the cavity and performs work in an quantum adiabatic process. It then enters another single-mode 
cavity which is in thermal equilibrium with another bath of black-body radiation at temperature T2 and whose mode matches 
the new energy gap A2. After a carefully controlled time, it leaves the cavity and moves quantum adiabatically back to the 
first cavity, having work done on it to have the energy gap increases back to Ai. With precise control of the time duration 
spent in each cavity, the system can extract more work in a cycle than it can if it is otherwise let to thermally equilibrate with 
the two heat baths in turn. 



the new energy gap A2 of the system. The average occupation of the only mode survived in the cavity has thus 
a (Bose-Einstein) thermal distribution fi.2 given by expression (|13|l . After some carefully controlled time interval 
T2, the system is removed from the cavity to enter stage 4. The probability to find the system in it upper state 
is now pu (T2). This is depicted on the right hand side of Fig. |21 Some heat is thus transferred but no work is 
performed in this stage. 

With the quantum adiabatic processes in stage 2 and stage 4, the cyclicity of the heat engines demands that 

pi'Ho) = pi'Hri). (18) 
On the other hand, the exit probability can be obtained as, with i = 1,2, 

Pu \^) — (initial probability in \ui)) x (transition probability from \ui) to \ui) in t) + 
(initial probability in \li)) x (transition probability from \li) to \ui) in t) , 

= p«(0)|(^,|^«(t))|2 + (1 -p«(0)) |(u,|^«(i))r (19) 

\'^u{i)i^)) state which starts out in the upper (lower) state - i.e., \il^u\o)) — \ui) and — \h) in the 

cavity at temperature T^. 

With the thermal distribution Ijl^fl assumed for the heat baths in contact with the cavities, the probability to find 
exactly n photons of frequency Ai/h in the cavity at temperature Ti is 



Pnm) = —— — ^ . (20) 

l + Ut \l + ni J 

In each of the cavities so described, the state of the engines satisfies the Schrodinger equation for a single two-level 
system interacting with a single-mode field which has the frequency matching the engine's energy gap, 

^^d}^ = %(a«a«+a«««t)|V;«), ^=l,2, (21) 
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with g is the coupling constant between the the quantum heat engine and the cavity mode, and the operators 
CF± = (cFx + iay)/2 act on the two-state space of the engine and a and are the operators on the Fock space of the 
field. The solution of this Schrodinger equation is given in |23|, from which we derive, through H19|l and H20|l. the 
probabilities 

oo 

:= A,J2PniT^)cOS^innt)+B^, (22) 
n=0 

where r2„ — g\Jn + 1. 

Note that when the sum on the rhs of the last equation collapses to a single summand term, PniTi) — > S{n — uq), 
corresponding to the radiation field being in some Fock state {hq), then we will have the Rabi oscillation in the level 
populations, which could then be exploited to apparently derive more work than otherwise allowed by the second law, 
but this is only apparent and cannot violate the law at all as discussed earlier. 

From the last expression we can find the bounds, as functions of the initial probability pi*'' (0) and the temperature 
Ti, of the probability pu \t) for all t. Figure ^ depicts these bounds. The probability for the system to be in the 
upper state upon leaving a single-mode cavity in contact with a heat bath as a function of the initial probability 
(upon entering the heat bath) is only accessible in the bounded areas (of red and blue). 

• For pi'\0) > where 

^critical = YT^' ^^^^ 
the coefficient Ai of the first term in (j22|l is positive, and so is the first term itself. Thus, for aU t, 

oo 

B^ < (t) < A, J2 Pn{T^) + = A., + B„ (24) 
because of the normalisation J2'^=o Pn{Ti) — 1. Substitution of Ai and Bi yields 



"'^\7"- ^"^^ < P^'it) < piHO), for pi;Lcai < PiHO) < 1- 



(25) 



This bounded region is depicted (in blue) in Fig. 0] 
• For Pu\o) < Pcriticaii Coefficient Ai is negative, and so is the first term. Thus, for all t, 

A,+B,<p^\t)<B,. (26) 

That is, 

P^m < P^(t) < for < p(^)(0) < (27) 

i -f- 7li 

This bounded region is also depicted (in red) in the same Figure. 

Note also that the vertex on the diagonal separating these two regions determines the stationary point where the 
probability is time independent and is equal to the initial probability. As the thermal equilibrium probability given 
by the Gibbs distribution must be independent of both time and initial probability, it is represented by a horizontal 
line crossing this vertex. 



For the cavity in contact with the heat bath at Ti, we want to have the exit probability to be greater (the greater, 
the more work can be extracted) than the initial probability, 

pi'Hri) > pi'H0)^pi'Hr2), (28) 
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FIG. 4: For the cavity in contact with a heat sink at T2 where we want the initial probability to be lowered upon leaving, 
the accessible leaving probability is bounded in the (blue) area under the diagonal, with its reflection shown in gray above the 
diagonal. The bounded (red) area above the diagonal is for the cavity in contact with a heat bath at Ti = r2(Ai/A2). The 
reflection of the point A at T2 across the diagonal is clearly not in the accessible region at Ti , as there is no overlapping of the 
two regions above the diagonal. So we cannot form a cyclic quantum heat engine which does work at these temperatures, even 
when Ti is greater than T2 by a factor (A1/A2). 



thus we need only to consider the appropriate portion of the bounds for this cavity, namely that above the diagonal. 
Reversely, for the cavity in contact with the heat bath at T2, we want to have the exit probability to be smaller (the 
smaller, the better) than the initial probability, 

pi'Hr2) < pi'H0)=pi'Hr,), (29) 

hence for this cavity we need only to consider the other portion of the bounds below the diagonal. Thus, we can also 
use this Figure 21 to elucidate the situation for the two heat baths in which Ti = r2(Ai/A2), the (red) area above 
the diagonal comes from Ti and the (blue) below the diagonal from T2. The coordinate of a point A in the (blue) 

area below the diagonal in Fig. ^is {pi^\o) , pi'^\T2)) , representing an exit probability less than the entry one at the 
cavity with temperature T2. The corresponding point at temperature Ti must have, by requirement of cyclicity, the 
coordinate 

ipi'H0),pi'\r,)) = (pi2)(r2),p(2)(0)), (30) 

which thus is the reflection of the point A across the diagonal. The gray area above the diagonal in Fig. 0] is the 
reflection of the (blue) area for T2. However, it is clearly seen that for Ti = T2(Ai/A2) this reflection is not in the 
accessible (red) area for Ti. We then conclude that at these temperatures, even with Ti greater than T2 by a factor 
(A1/A2), the quantum heat engines cannot do work on the average. As a consequence of the temperature-independent 
efficiency similar to ©, the engines cannot neither absorb nor transfer any heat. 

In Fig. |5l we combine the relevant bounds for T2 below the diagonal (in blue) and those for Ti above the diagonal 
(in red) for the choice Ti < T2(Ai/A2). It is seen once again that no work is derivable on the average. Not only we 
have thus confirmed the second law that, on the average, no process is possible whose sole result is the transfer of 
heat from a cooler to a hotter body, with or without a production of work. But we have also clarified the degrees of 
coolness and hotness in terms of the quantum energy gaps involved before such a process is possible; namely, we must 
have Ti > T2(Ai/A2), as in {Tj) once again. 

We now show how our quantum heat engines are capable of performing more work than can be derived from thermal 
equilibrium otherwise. In Fig. El which combines the case Ti > r2(Ai/A2), there is some overlap between the (red) 
area for Ti and the reflection of the area for T2 across the diagonal. In this case, it can be seen that the production 
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Initial Probabilities 



FIG. 5: Similar to Fig. 0]but this time with Ti < T'2(Ai/A2). Once again we cannot have a cyclic quantum heat engine, even 
for Ti in the range Ta < Ti < T2(Ai/A2). 



of some work, AWcav, is now possible, 

lAW^cavl = (pW(ri)-p(^)(T2))(Ai-A2). (31) 

In general, if and when we choose to operate with a point below the thermal equilibrium line in the (blue) area 
for T2 such that its reflection across the diagonal is above the thermal equilibrium line in the (red) area for Ti as 
shown in the figure, we can derive more work than the case of thermal equilibrium. The work done is proportional to 
the difference in probabilities as shown in 10} and 131|l . Here | AWcav | is greater than the work derivable at thermal 
equilibrium, |AWth|, because the vertical distance between point A and its reflection in Fig. is greater than the 
vertical distance between the two horizontal lines, which represent the two thermal equilibria. 

From the bounds H25|) and H27|) . we can evaluate the maximum amount of work extractable from our modified 
quantum heat engines at given temperatures 

max|AVFcav| ^ (1 + 2ni) (1 + 2^2) ^ , . 

lAWthl (l + ni+na) ' ^ ' 



VIII. AN ILLUSTRATION 



As an illustration that we can choose and a priori fix the time ti and T2 for all the cycles of the modified mode of 
operation for our quantum heat engines such that more work can be derived than otherwise available from thermal 
equilibrium, we present herein the example in Figs. [3 and |S1 These numerical results are obtained from H22|l with 
g — 1 and other parameters as stated in the captions. Note that in Fig.dthe probability at subsequent time is always 
more than that of the initial time, in agreement with the fact that the (red) area for Ti is above the diagonal in Fig.|Sl 
The reverse is true for Fig. |S1 because the (blue) area for T2 is below the diagonal in Fig. 



IX. MAXWELL'S DAEMON REVISITED 

The expression (|22|l for the probability, derived from 119|) . requires some careful justifications. Following [23|, we 
expand the state vector lip) (dropping the superscript (i)) in terms of \u, n), in which the engine is in the upper state 
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Initial Probabilities 



FIG. 6: Similar to Fig. gl but this time with Ti > T2(Ai/A2) > T2. We can form a cyclic quantum heat engine at these 
temperatures, in broad agreement with the classical statement of second law. The maximum work that can be extracted in a 
single cycle is proportional to the length of the (yellow) vertical double arrow and is more than that for thermally equilibrated 
situation, which is proportional to the distance between the two horizontal (green) lines which represent the thermal equilibrium 
probabilities for these Ti and T2 respectively. 




p=0 .29 
Thermal 



p=0 ■ 165 



2 4 6 8 10 12 

Time 

FIG. 7: Pu^ versus time according to eq. 1221 . The system enters a single- mode cavity, in contact with a heat source at 
temperature Ti (here, fcTi/Ai — 1.5), with the probability in the upper state pi^'(O) = 0.165 (= pP'(t2), by cyclicity 
requirement) and leaves the cavity, at suitably chosen time ri, with the increased probability Pu^''(ri) = 0.29. This latter 
probability is larger than the thermal equilibrium probability at this temperature (dashed line). 



\u) and the field has exactly n photons, and of |^, n) in which the engine is in the lower state |Z), 

\^) = ^(c„,„(t)|u,n) + q,„(t)|/,n)). (33) 

n 

From this, the Schrodinger equation (|21|1 can now be replaced by 

Cu,n = ~ig^/n + 1 Q^„+i, 
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FIG. 8: pi^^ versus time. Similar to Fig. |7|but this time the probability upon entering a cavity, in contact with a heat sink 
at temperature T2 < ri(A2/Ai) < Ti (here, feT2/A2 — 1.0), is pu^'(O) = 0.29 {— pi^'(Ti), by cyclicity requirement) and upon 
leaving, at suitably chosen time T2, is pi^\T2) = 0.165, completing a cycle of the quantum heat engine. The latter probability 
is lower than the thermal equilibrium probability at this temperature (dashed line), thus allowing more work to be extracted. 



ci,n+i = -igVn + lcu,n- (34) 

The general solutions for these probability amplitudes are 

c«,„(i) = c„,„(0) cos (Qnt) - iQ,„+i(0) sin(r2„i), 
Q,n+i(i) c;,„+i(0)cos(ri„t) - ic„,„(0)sin(r2„i), (35) 

in which the initial probability amplitudes are assumed to be factorised, 

Cn,n(0) = VpJO) X 

c,,„+i(0) = e''^^l-pu{0) X e'^f^B^, (36) 

where the relative phases 9s for the engine and Of for the field, respectively, are not zero in general. 
Now, we can also express the probability on the Ihs of (|22|l as 

Puit) = ^|c„,„(Or (37) 

n 

Direct substitution of the amplitudes above, however, leads an additional cross term which does not exist on the rhs 
of expression H22|) but is proportional to 

~ n Ite^'^ Vp40)(1-p40)) X J2 e''' 

Pn+i COS (flnt) sin (Qnt) J . (38) 



Accordingly, the various bounds for Pu{t) will be modified by the term ■y/p„(0) (1 — p„(0)), which is nonlinear in 
Pu{0), unlike the situation in H251 127(1 depicted in Fig. 01 from which the second law was seen to be followed. One 
might think that this extra non-linear term could be exploited to beat the second law (thanks to the newly emerged 
overlapping of regions which were not overlapped previously in Fig. 0. But this is not meant to be, however. The 
reason for this impossibility is that, in general, the various phases in H38|l are not fixed but can be random, especially 
for the phase Of oi the thermal field. They will have to be averaged over, rendering the cross term (138(1 vanished after 
all. We thus get back the expression exactly. 

If the phases could be controlled physically then the second law might be violated. But the point to be emphasised 
here is that such a control of the phases will require some careful operation which is nothing more than just another 
disguised act of Maxwell's daemon. In the end, any such resulted violation of the second law, if possible, is not and 
should not be surprising at all. 



15 



X. QUANTUM HEAT ENGINES WITH 1-D SIMPLE HARMONIC OSCILLATORS 

We now generalise some of the above results to quantum systems having an infinite number of energy levels. Firstly, 
we consider a 1-D simple harmonic oscillator of frequency cui in thermal equilibrium with a heat bath at T^. The 
oscillator is then removed from the heat bath to undergo a quantum adiabatic expansion until its frequency is dropped 
to 0)2- It is then equilibrated with another heat bath at temperature T2 before undergone another quantum adiabatic 
compression to raise its frequency back to lui . In one such cycle, the oscillator performs an amount of work. 



00 

= n{uj,-u:2)Y.n(p^^^-pi^^), (39) 

ra=0 

with the Gibbs distributions for i = 1, 2 

p« = (l-e-"-)e-""% (40) 

and 

kT, 

We have used the energy expressions for simple harmonic oscillators 



(41) 



= [n+^^hu,. (42) 

Let 

X = a2 — Oil (43) 

and consider the sum in H39|) as a function of x, 

00 

f{x) = ^n{(l-e-"i~^)e~""i~"^- (l-e-"i)e-""i}. (44) 

Its derivative is 

00 

f{x) ^ - E me-'"("i+^\ (45) 

m— 1 

which is always negative (we always have x > —ai for the convergence of the infinite sum, as a2 > 0). Thus f{x) 
is a monotonically decreasing function; in particular, f(x) < /(O) = for a; > 0. From the definition of x (I43|l and 
f{x) (|44|l we conclude that the oscillator can only perform work on the environment {i.e. when f{x) < 0) if and only 
if X > 0, which means that a2 > ai. That is, 

Ti > T2 (^^) (46) 

is the necessary and sufficient condition for work to be performed by a quantum simple harmonic oscillator in such a 
cycle described above. 



XI. QUANTUM HEAT ENGINES WITH 1-D INFINITE SQUARE WELLS 

Similarly to the last Section, but we now replace the oscillator by a particle of mass m in an 1-D infinite square 
well. The work performed in a cycle is also 

00 

AW = 5](£;W-£;W)(pW-pW), (47) 

n=0 
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but this time with the energies 



and the thermal distributions 

pi'' = — (49) 

where /3i — l/{kTi) and Li are the widths of the weUs at T^. 
Let 

y = /32-/3i, (50) 
and consider the rhs of (|47|l as a function g oi y. Its derivative wrt y can be written as 

g\y) = - + - E^^\{E^^\, (51) 

where 

{0)y ^ J20nPi'\ (52) 

71 

(2) 

note that pn is a function of y. 

Substituting the energy expressions H48fl into the derivative (jSlll . with L2 > Li, 

which is not positive, but can vanish, thanks to the well-known positivity property of the expression in the first pair 
of curly parentheses. Noting that g{Q) = 0, we have AW — g{y) > g{0) = if and only ify<0; that is if and only if 

Ti < T2. (54) 

This is the condition upon which the system cannot do work and and which is in accordance with the second law of 
thermodynamics. 

Note also that the above mathematical derivation can also be applied to the simple harmonic oscillators of Sec- 
tion^ once we replace the energy expressions (|48|) by those of (|42|l . However, the ability to exactly evaluate the 
partition functions of the simple harmonic oscillators of Section |3 enables us to derive the condition H46|l . which is not 
contradictory to but has a more positive interpretation than the condition (|54|l above: even though AW — g{y) < 
if and only «/y > 0, we cannot conclude, because of the possibility that g{y) can vanish, that the system can do work 
if Ti > T2. This thus is consistent with H46|) . which is the condition whence work can be extracted. 



XII. CONCLUDING REMARKS 



By interpreting work and heat, but without referring to entropy directly, in the quantum domain and by applying 
this interpretation to the simplest quantum systems, we have not only confirmed the broad validity of the second law 
but also been able to clarify and refine its various aspects. On the one hand, explicitly because of the probabilistic 
nature of quantum mechanics, there do exist physical processes which can violate certain classical statements of the 
second law. However, such violation only occurs randomly and thus it cannot be exploitable nor harnessible. On the 
other hand, the second law is seen to be valid on the average. This confirmation of the second law is in accordance with 
the fact that, while we can treat the quantum heat engines purely and entirely as quantum mechanical systems, we still 
have to assume the Gibbs distributions for the heat baths involved. Such distributions can only be derived ^25.] with 
non-quantum-mechanical assumptions, which ignore, for example, any quantum entanglement within the heat baths. 
Indeed, it has been shown that [26Ll27| the law of entropy increase is a mathematical consequence of the initial states 
being in such general equilibrium distributions. This illustrates and highlights the connection between the second law 
to the unsolved problems of emergence of classicality, of quantum measurement and of decoherence which are inter- 
related and central to quantum mechanics. Only until some further progress is made on these problems, the classicality 
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of the heat baths will have to be assumed and remained hidden in the assumption of the Maxwell-Boltzmann-Gibbs 
thermal equilibrium distributions. 

Even our results support the second law, on the average, we have further clarified the degree of temperature 
difference Q, in terms of the quantum energy gaps involved, between the heat baths before any work can be extracted. 
While the Carnot cfhciency is an upper bound for that of the quantum heat engines, the former could be approached 
by the quantum engines with the introduction of an infinite number of alternating adiabatic and heat transferred steps. 
The implication of this approach in the context of quantum information deserves further investigations elsewhere. 

Inspired and motivated by the Rabi oscillations, we have also shown how to extract more work from the heat baths 
than otherwise possible with thermal equilibrium distributions - but more heat input would also be needed in such a 
way that the Carnot efficiency is still a valid upper bound. Note that such an operation is subject to the bounds given 
in H25|l and H27|) . which then, as can be seen through their depiction in the figures, ensure that we stay within the 
second law, but refined with the necessary condition The perfect agreement between the specific results derived 
from the quantum dynamical bounds H25() and H27I) with the general result (UJ derived from statistical mechanics is 
quite remarkable. We speculate that such agreement is not accidental but is a consequence of the Gibbs distributions 
assumed for the heat baths in both derivations; and the agreement should thus be independent of specific details of 
the quantum dynamics involved. Note also that the modified operation with single-mode cavities is not an operation 
of Maxwell's daemon because the information about the time intervals ri and T2 is fixed and forms an integrated 
part of the modified engines. This information, being common to all cycles, need not and should not be erased after 
each cycle to preserve the cyclicity condition. Other studies of very different classes of quantum heat engines 13, l^ 
have apparently claimed similar results that more work can be derived than from classical engines. (However, if the 
cyclicity condition is not strictly observed for a heat engine, as in the case for some of those studies, then some extra 
effects may be hidden or unaccounted for, such as those associated with a maintenance of some coherent states or 
some Fock state, and apparent violation of the second law might thus be possible.) 

Our class of quantum heat engines can also readily offer a feasible way to physically realise Maxwell's daemon, 
in a way different to Szilard's engine but also through the acts of quantum measurement and information erasure. 
Finally, some of our results above have also been generalised to quantum heat engines having an infinite number 
of energy levels, specifically the 1-D simple harmonic oscillators and 1-D infinite square wells. Some analysis of 
three-level quantum heat engines has also been available recently , but because of the many different energy gaps 
available (similar to the case of square well) , different conditions with different combinations of gap ratios could enter 
a counterpart of Q above. 
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